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>  This  paper  addresses  the  problem  of  determining  and  generating  outcomes  for  a  joint 
multivariate  distribution  having  specified  arbitrary  marginal  distributions  and  correlation 
structure. 

In  addition,  a  new  technique  is  developed  which  generates  outcomes  for  essentially  any 
given  multivariate  random  variable  from  a  more  conveniently  realizable  random  variable. 
This  generalizes  in  a  natural  way  the  well  known  univariate  transformation  of  probability 
sampling  technique. 
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GENERATION  OF  A  MULTIVARIATE  DISTRIBUTION 
FOR  SPECIFIED  UNIVARIATE  MARGINALS  AND 
COVARIANCE  STRUCTURE 

I.  INTRODUCTION 

During  a  discussion  pursuant  to  a  proposed  new  nonlinear  convolution 
filter  of  the  Wiener  type  [l],  the  problem  arose  of  verifying  the  accuracy 
of  this  filter  with  respect  to  the  standard  linear  Wiener  filter.  This 
would  require  the  generation  of  a  nongaussian  stochastic  process,  since 
for  the  gauss ian  case,  for  simple  additive  noise,  the  linear  filter  cannot 
be  improved  upon.  (See,  e.g.,  (51.  Chapter  3.)  For  purposes  of 
sensitivity  analysis,  it  was  agreed  that  choice  of  the  scalar  marginal 
random  variables  and  covariance  structure  of  the  stochastic  process 
should  be  made  as  wide  as  possible. 

Consequently,  the  following  three-stage  statistical  problem  arose: 

Given  a  set  of  univariate  marginal  probability  distributions: 

(1)  Determine  the  class  of  possible  correlations  between  random 
variables  having  these  distributions. 

(2)  Determine,  for  each  allowable  set  of  correlations  in  (1),  a 
corresponding  (joint)  stochastic  process  yielding  back  the  given  set  of 
marginals. 

(3)  Establish  a  procedure  for  generating  outcomes  of  each  stochastic 
process  specified  in  (2). 

Man  uteri  pt  submitted  October  24, 1980. 
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This  brief  memorandum  addresses  itself  to  the  above  problem,  and 
under  mild  restrictions,  answers  it  in  the  affirmative  ,  when  the  set  of 
univariate  probability  distributions  is  finite. 

In  treating  this  problem,  two  byproducts  resulted:  A  simple  method 
for  the  special  case  of  determining  a  bivariate  distribution,  given  two 
marginals;  and  a  transform  of  probability  technique  from  a  multivariate 
uniform  to  any  of  a  wide  class  of  multivariate  distributions,  generalizing 
the  well-known  univariate  procedure.  These  results  are  presented  in 
Appendices  A  and  B. 


I  t .  ANALYS I S 


Following  a  cursory  view  of  the  available  literature,  Johnson  and 

Kotz*  text  [2],  Chapter  3**  (pp.  1  -36)  and  Chapter  42  (pp.  273  et  passim) 

was  found  to  present  a  brief  survey  of  techniques  which  relate  to  part  (2) 

of  the  problem  posed  here,  without  involving  explicitly  the  specification 

of  the  covariance  structure.  Hardia's  monograph  [3]  has  a  much  more 

extensive  treatment  of  the  problem.  Some  of  the  results  presented  here 

are,  in  part,  extensions  of  the  FrSchet-Nataf  'translation  method'  for 

bivariate  fami 1 ies  (which  do  not  particularly  address  the  specification 

of  the  covariance  matrices),  exhibited  in  [3l. 

In  the  following  development,  let,  for  each  index  i,  i  ■  1,  ...  ,  m, 

£.  be  any  univariate  marginal  random  variable  with  ordinary  probability 

density  function  f.,  probability  distribution  function  F. ,  mean  u. , 

2 

variance  a..  =  a.  ,  median  8.  and  mean  absolute  deviation  about  the 
ii  i  '  i 

median  ?. ,  all  assumed  known. 

As  usual,  E_(X)  and  CovF(X)  denote  expectation  and  covariance  matrix 

r  a,  r  % 

of  random  variable  X  with  respect  to  distribution  F,  etc. 

'V 

y  denotes  the  probability  distribution  function  corresponding  to  the 

standardized  normal  scaler  distribution  n(0,  1),  while  ip  denotes  the 

probability  density  function  for  n(0,  l).  .<_  denotes 

m  U  *2.1  p J 

^an  arbitrary  (positive  semidef ini te)  m  by  m  correlation  matrix,  where 
Pii  =  1  and  |p,  j  |  <  1,  p..  -  corr(£.  ,£j)  -  E^.-u,)  Uj -11^0,0.)  . 

Denote  alsol^  r=^|^(m  by  l),  ,  0m  ^  ^  (m  by  1). 

X  ==f'v'’,l,  X  (:M  ,  where  x.  eR  is  any  outcome  of  marginal  random 

■\J»  Ii  m  Urn/  1 

variable  x.  (which  can  be  arbitrary,  unless  specified)  corresponding  to 

'Vl 

f . ;  i  ■  1 ,  . . .  ,  m.  All  monotonic  properties  of  distribution  functions 
and  positiveness  of  densities  are  with  respect  to  an  assumed  interval  of 


support. 


For  ft  »  I  and  1*1  ,  define  the  functions  F(*;^  )•  R  "P  [0,1], 

m  \  m  m  m  m 

where  for  any  X  eRm, 
m 


df 


F(X;1  )  =  n  F  (x.) 
mm  j.t  '  i 


F (X  ;  1  1  —  min  F.  (x. ) 

m’  m  m  —  |-i , . . . i  i 


(1) 

(2) 


Define  also  F^:Rm  -*•  [0,1],  by,  for  all  Xm£Rm, 


F*  (X  )  ==  max( .  ,  £  F.(x.)  -  (m-1),  0)  . 

lm;  m  i«l,TT.  ,m  '  i 


(3) 


Then  the  following  properties  hold  (see  [3],  pp.  30-35,  for  the 
bivariate  case  of  m  *  2) : 

Lemma  1 

T  * 

(a)  F(  ;I  ),  F(  ;1  1  ),  and  F,  v  are  all  m-variate  probability 

m  mm  (tn) 

distributions  possessing  F.  F  as  marginal  distributions. 

i  f  •  •  f  m 

(b)  For  any  joint  probability  distribution  F  ,  possessing 

1 , . . .  ,m 

marginal  distributions  F.  F  as  above,  for  all  X  eRm, 

1 , .  •  • ,  m  m  ’ 


F(m) 


(x«> ; F, , 


n,(Xj  <  F(X  ;l  ,1  ). 

,m  m  —  m  m  m 


w 


(Proof :  Omitted  as  a  straightforward  generalization  of  the  results 
In  [3].  ) 

□ 

Remarks 

1.  Note  the  case  of  F  ■  F(  ,1  )  for  (4);  F(  ,1  )  is  the  probability 

m  m 

distribution  function  corresponding  to  ^  ^  being  statistically 
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independent. 

2.  F(  corresponds  to  ^  all  being  monotone 

increasing  functions  of  each  other.  This  implies  the  unique  relation 

F|<«,>  -  F2(*2> - rM  •  (5) 


.e. 
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*i 


i  *  I  f . . .  |  nt  f 


provided  each  F.  is  a  monotone  increasing  function.  Thus,  if  g:Rm  -*•  R  is 
any  function, 


/  g (X)dF(X; II 
XeRm  m 


/  9( 


x^eR 


I 

f-'f,(x,) 
,%'<F1(X  !»/ 


(6) 


among  several  representations. 

* 

3.  F^mj  corresponds  to  the  functional  relation 


Z  Fj^.)  -  m  -  1  . 

i*l 


(7) 


Lemma  2 

For  any  i  +  j,  1  <_  i ,  J  <_  m,  and  any  joint  probability  distribution 

F.  .  possessing  fixed  marginal  distributions  F. ,  F.,  and  densities  f . , 

•  *J  *  J  ' 

f . ,  with  f .  >  0 
J  J 
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—  T'T 


a. 


,j  - 


((x. 


'  ,J 


xj)2)  i  6ij 


(8) 


where 


aij  EH(  ;12lJ)^I  ”  ^  ) 


f  (x.  -  F:1(F.(x.))2dF.(x.) 
x.eR  1  J  '  '  11 

I 


(9) 


/  (fT1 (F  (x  ))  -  x.)2dF  (x  )  ; 
x.eR  1  -I  J  J  J  -f 


the  latter  two  relations  holding,  if  F.  and  F^  are  monotone  increasing; 
and 


B..  asE  ((x.  ’  X.)2) 
■J  F|2) 


(10) 


/  (x.  -  Fj:,(l-F.(x.)))2dF.(x.) 


x.eR 

i 


/  (F  1 (I-F  (x.))-x.)2dF.(x.)  . 

x.eR  J  J  J  J  J 

i 


Again,  the  last  two  equalities  hold,  if  Fj  and  Fj  are  monotone  increasing. 

Upper  equality  in  (8)  holds  for  F.  .  -  F(  ;!  *1,T);  lower  equality 

holds  for  F. .  -  F?,,. 

i  J  (2) 

(  Proof: 

Using  Fublni's  Theorem  on  iterated  integration  and  Lemma  1  (a)  for 

m  ■  2, 
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Fli  J  X 


/  (  S  (x.-Xj)2dF^j | j J (Xj |Xj))dFj (Xj)  J 


eR  x.>x. 
J  J 


(11) 


E  T  *  /  (/  (x.-x  )dF(.  |  n(x  |x.)dF  (x  )  . 

F(  ;1,1,T)  '  J  x.eR  x.>x.  1  J  1  -1  J  J 

2  2  J  »—  J 

Now  the  conditional  distribution  functions  F^.  |  j  j  (x.  jx^.)  ■ 

F. j (xj ,Xj)/f j (x. )  and  f|?| ^ (x. |x^)  «  F(x. ,Xj ; !2l2T)/f. (x^ ) . 

Thus  Lemma  1  (b)  (eq.  (4))  implies  that  for  all  x.,Xj£R,  F^. | ^ (xj |x.)  £ 
F(?ij)(xi lXj)‘  ^ince  f°r  xj  ^ * xed ,  (x.-Xj)2  is  an  increasing  function  in 
x. ,  it  follows  that  (see,  e.g.,  Lehmann  [4],  page  73,  Lemma  1  and,  page 


112,  Example  11)  for  ail  x.  x j »  f°r  any  fixed  Xj , 


'vV  dF(i|j)(xiixj> 

1-  j 

-  *{<  (xrxj)2dF<?ij)(xt|xj) 

i-j 


(12) 


Substituting  (11)  into  (12)  yields  the  lower  inequality  in  (8). 

By  a  similar  argument,  reversing  inequalities  from  Lemma  1,  yields 
the  upper  inequality  in  (8) .  ) 

O 

The  next  result  establishes  the  allowable  range  of  values  for 
Corr(^c.  ,£j)  for  given  marginal  densities  f.  and  f j . 

Theorem  1 

Let  ,^j  correspond  to  fixed  densities  fj.fj,  respectively, which 
are  positive,  for  i  i  j;  1  <  i,  j  <  m. 

Then  for  any  joint  bivariate  distribution  F.^  possessing  marginals 
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(13) 


y. .  i.  Corr_  (x.  ,x.)  ^  T. .  , 

U  -  Fjj  •  J  ”  U 


where 


2  2  2 
a.  +  a.  +  (u.-y .)  -  8. . 

Y  4f  i  _  j  ,  i _ i _ u_ 

'i  j  —  2a, a. 


'  J 


T.  .  = 

'J 


2  2  2 

,r  a.  +  a.  +  (y.-y .)  -  a. . 

df  i  j _  i  j _ i  j 


2a. a. 
«  J 


(14) 

(15) 


and  a.j,  8.^  are  given  in  Eqs.  (9)  and  (.10). 


(  Proof; 

Using  Lemma  2,  expand  out  the  expectation  in  Eq.  (8),  yielding  a 


bound  on  Ep  (^.^.).  Subtracting  y.-y.  and  dividing  by  a. a.  yields 
ij  1  -1  1  J  1  J 

the  final  results.  )  _ 


Remarks 


Suppose  i  ^  j ;  1  <  i ,  j  <  m. 


1.  Upper  equality  to  T.j  in  (3)  is  achieved  for  F.j  *  F(2) 5 

lower  equal i ty  to  y. . ,  for  F..  «  F(* , I,- 1.) .  Thus,  - 1  <  y, .  <  T. .  <  1 

ij  ij  22  —  ij  —  i  j  — 


2 .  Assuming  that  F.  and  F.  are  monotone  increasing: 

'  J 


TU  •  1  iff  “ij  -  <Vaj)Z  *  (V,j)2  . 


(16) 


y.j  -  -1  iff  8. j  -  (a.+Oj)2  +  (y.-y^)2  . 


(17) 


A  sufficient  condition  for  T. .  ■  1  to  hold  is 

•J 
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(18) 


F.(-)  -FjU-hfj)/  a'.)  , 


for  any  constants  b' .  and  a'.  >  0.  (Thus,  it  holds  for  F. 

U  U  ' 

value  is  achieved  if  x.  *  aT.-x.  +  b 1.  s  F.  '(F.(x.)), 

'  'J  J  <J  ‘  J  J 

A  sufficient  condition  for  y..  *  -1  to  hold  is 

•J 


F..)  This 
J 


F.(-)  -  l-F.«b':~)/a'J> 


(19) 


for  any  constants  b'.'.  and  a'.'  >  0.  This  value  is  achieved  if 

ij  U 

x.  =  -  a'.'  x.  +  b','.  =  F.  ^ (1-F. (x.)) . 
ij  J  'J  i  J 

3.  In  particular  (corresponding  to  b T j  =  0,  aj\  =  bCC  =  2H. , 

*  1),  if  F.  *  F.  and  is  a  symmetric  function  about  U.  =  U.,  i.e. 
i  j  —  ij  ij 

F. (x. )  ■  1  -  F. (2y.  -  x.),  for  all  x.eR,  then  it  follows  that  o. .  *  0 

2 

(this  does  not  require  the  symmetry  condition),  T. .  =  1,  B..  *  4a.  * 

2 

4a.  ,  and  V- •  *  "I • 

J  U 

D 

Now,  denote  for  any  m  by  m  correlation  matrix  ,  the  m-variate 


zero-mean  gaussian  distribution  N  (0  ,&  )  with  corresponding  probability 

m  m  m 

density  function  and  probability  distribution  function  'F0m.  Define, 


Dm" 


for  given  monotone  increasing  marginal  distribution  functions  F^ ,  ...  , 

F  .transform  T  :Rm  -*■  Rm,  where,  for  any  X  eRm, 
m  m  m 


F.  ’’ Wx,)) 

T  (X  )  Mz  .  , 

*  F  (V(X  )) 
m  m 


(20) 


with  the  inverse  transform 
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w 


vf~  (F,  (x,  ) ) 

t“'(X)£’ 

m  m  ^  4'~ 1  (F  (X  ) ) 
m  m 


(21) 


Next,  define  the  function  F(  ;flm) :  R 


[0,1],  where  for  any 


X  eRm, 
m  ’ 


F(X:G  )  =  »  (T  “'(X  )) 
mm  06  m  m 
m 


(22) 


(See  [3],  pp.  30-35,  for  the  case  m  =  t.) 

Finally,  <et  V^sl^'^be  any  random  variable  corresponding  to 

N  (0  ).  (Thus,  each  v.  is  distributed  as  n(0,!).) 

m  m  m  >vi 

The  major  result  of  this  is  presented  in  the  following  theorem: 

Theorem  2  (Extension  of  Frechet-Nataf 1 s  Translation  Method  [3]) 

Let  F,  F  be  m  given  monotone  increasing  scalar  marginal 
I . m 

probability  distribution  functions  with  corresponding  positive  densities 
f,  f  ,  and  random  variables  x,  x  . 

!»•••>  m  rV/  I  f  •  •  •  f  'NjJTI 

Then,  for  any  correlation  matrix  Q'm  «  <P'i j> ,<} , j<m  (which  must  be 
always  at  least  positive  semidefinite)  such  that 


Y. .  <  o'.  <  T. . 

•J  “  iJ  ~  U 


(23) 


where  and  T.^  are  given  in  eqs.  (14)  and  (15),  for  all  i  ?  j , 

1  i ,  j  m: 

(a)  There  exists  a  corresponding  correlation  matrix  fi  -  (p..).,. 

m  i  j  i<_i  ,  j  <m 

such  that  F{  )  is  a  joint  m-variate  probability  distribution  of  random 


var 


iable  X  ==  ,  which,  possesses  marginal  probability  distributi 

^  \U 


on 
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functions,  densities  and  random  variables  and  £l  <m* 

respectively,  such  that 


Corr  (X  )  «  ft*  .  (2k, 

m  m 

F(-;S!m> 

(b)  Random  variable  ^  can  be  considered  in  the  following  functional 
relationship  with  respect  to  V  : 


X  =  T  (V  )  . 

r\/n  m  ryjn 


(c)  For  ft*  ■  (T. .  (T. .  =  1),  the  upper  bound  in  eq.  (23),  we 
m  i  j  I  <  i  ,  j  <ffl  i  i 

can  choose  ft  *  1  •!  T  and  F(*;l  1  T)  is  the  same  as  previously  defined 


m  mm 


in  Eq.  (2) . 


(d)  For  ft*  *  I  ,  we  can  choose  ft  ■  1  and  F ( * ; I  )  is  the  same  as 

'mm  mm  m 

previously  defined  in  Eq.  (1). 

(e)  For  ft*  with  at  least  some  entires  p(  .  *  y...  the  lower  bounds  in  (23), 

m  •  J  1 J 

we  can  choose  corespond ingly  in  ftm>  p.j  =  _1,  which  yields  the  bivariate 
F.j  *  F (  ;  (_])  •  (_J)T)  =  f(2)’  as  given  5nEq*  <3)' 

(  Proofs: 

(b)  follows  from  (22).  (c) ,  (d),  (e)  all  follow  from  basic  properties 

of  m-variate  gaussian  distributions. 

For  (a):  Without  loss  of  generality,  consider  for  any  ft  ,  the  first 


marginal  component  of  F(Xm;fim): 


<F<Vn„»i  -  F<  :  -v  «  T.  (,) 


T*1 CF, (x,)) 

ill"  1  /  ,  \ 


m 


11 


.  w 


( ¥_1 (F, (*,))  \ 


+  » 
+  oo 


)  -  (Fj  (xf)))  •  Fj  (x j ) . 


Thus,  {F (  is  arb.  P«s*  semldef ini te}  *  family  of  m-variate 

distributions  of  ^  yielding  back  the  required  marginals.  Clearly, 

for  any  fixed  i  j*  j  ,  ^orr(F(  .q  *s  indeed 

a  continuous  function  of  ft  -  in  fedt.of  p..-  which  achieves  its  maximum 

m  i  j 

value  (see  Theorem  I  and  ensuing  remarks)  T.j,  for  **  lnlm  (p.j  *  1)» 

and  its  minimal  value  y. . ,  for  such  that  p. .  “  -1,  i.e.,  for  bivariate 

Ij  m  »J 

marginal  F..  «  F^2)  »  F(  ;(_])(_])  )•  Thus,  Corrp(  ;0  can  take  ahy 

value  between  y..  and  T. .  by  proper  choice  ofJl  .) 

i  j  i  j  m 

Remarks 

1.  |f  F.  •  F«  ■  ■  F  is  a  symmetric  function  about  mean  y. 

12m  • 

(Fj  (x, )  =  1  -  FjUuj-x,)),  then  y.}  -  -1  and  Tfj  -  1,  and  thus,  ST  i 
Theorem  2  can  be  arbitrary  (and  (23)  is  always  satisfied). 

2.  Rewriting  q.  (2k)  in  scalar  form 


in 


p'j .  -  Corr (x. ,Xj) 

F<  -V 


Corr(x. ,Xj) 


(26) 


for  any  given  Yj j  l.pfj  —  Tjj»  where  ‘s 

iate  marginal  distribution  function  of  F,  and 


the  corresponding  bivar- 


l<i ,j<m 


Lancaster  and  Kendall  &  Stuart  (see  [33  >  page  33)  have  shown  that  for  all 

Hi  ,j^n. 


Kj  1 1 1»  iji 


(27) 
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with  strict  inequality  holding  in  (27)  for  i  +  j,  unless  the  F.'s  are 
all  gaussian  distributions. 


For  any  given  Pj\,  with  strict  inequalities  both  holding  in  (23)  > 
solving  for  p.^  in  (26)  is  equivalent  to  solving  for  P j ^  in: 


H. .  (P.  .) 
'J  U 


(1/(0.  *cr.))  j^F.  '  (4'(v.))-p.)  (F.  '  (y(v.))-y.)* 

1  J  i\t  \  '  1  J  J  J 

■}  ,  .  ,(vi’vjJdvidvj 

U,j 


0 


(28) 


where 

’f  (v.,v.)  *  (lA2ir-/-pj .  ))  *exp-{  i(l-p?,)* 

n  p,j\  1  ,J  IJ 

Vlj'J  .(V.2  *  V.2  -  2C..V.V.  »  .  (29) 

Thus,  for  purposes  of  implementation,  the  integral  on  the  right  hand 
side  of  (28),  Hjj(pjj)  should  be  tabulated  as  a  function  of  p.j,  for 
-1  <  p.j  <  I.  Then  that  p.^  satisfying  (28)  could  be  found  by  a  graphical 
method. 

3.  For  m«2,  an  alternative  simple  method  for  constructing  the  joint  bi¬ 
variate  probability  distribution  for  specified  marginals  F^  and  F^  is 
presented  in  Appendix  A. 

A.  For  general  m  again,  Eq.  (25)  can  be  used  to  generate  outcomes  of 
X  .  This  thus  depends  on  the  generation  of  outcomes  of  V  .  A  standard 

A/n  rjn 

procedure,  is  to  first  in  effect  decompose  ft  *  P  D  P  where  P 

m  m  m  m  m 

is  the  orthonormal  matrix  of  eigenvectors  and  D  is  the  diagonal  matrix 

m 

of  eigenvalues  of  ft.  Then  the  random  variable  V  can  be  written  as 

m  <vfll 


is 


.  V 


V  »  P  W  ,  where  random  variable  W  * 

m  ^fn  rj** 


.  .  is  distributed  N  (0,0  ). 

m  \  |  mm 

w 

'vm . 


Hence,  the  w.'s  are  distributed  statistically  independent  with  w. 


distributed  n(0,  d.  )  where 


D  ==  l|\.  .  i1  I  .  Finally,  we  can  apply  the  fundamental  transformation 
m  *  |0  \®m 

of  probability  from  a  uniformly  distributed  random  variable  z.  over 

f\j  I 

[0,1]  :  w.  -  »_,(*.)  ;  i«l,..,m.  Hence  we  can  first  generate  statis- 

n.' 

tically  independently  outcomes  z.,..,zm>  obtaining  in  turn,  outcomes 

w.,..,w  ,  forming  W  ,  and  in  turn  finally,  V  . 

I  m  'wn  »v.m 


5.  An  alternative  procedure  for  not  only  generating  V  ,  but  for 
obtaining  essentially  any  m-variate  random  variable  by  a  transform  of 
probability  from  any  convenient  initial  m-variate  random  variable  -  such 
as  a  uniformly  distributed  one  over  the  unit  m-cube  -  is  given  in 
Appendix  B.  This  technique  could  be  of  especial  use  when  nongaussian 
random  variables  are  sought  and/or  when  m  is  large,  since  no  matrix, 
inversion  is  required.  However,  the  forms  of  the  marginal  probability 
distribution  functions  are  required. 


III.  SUMMARY 


The  problem  of  constructing  and  realizing  outcomes  for  a  multivariate 
distribution  compatible  with  arbitrary  given  scalar  marginal  distributions 
and  having  a  specified  correlation  matrix  has  been  considered  here.  The 
problem  is  essentially  answered  in  the  affirmative  in  Theorem  2.  In  addi¬ 
tion,  an  apparently  new  multivariate  transformation  of  probability  techni¬ 
que  which  is  triangular  in  form  is  presented  (Appendix  B)  for  generating 
outcomes  of  a  given  random  variable  from  a  more  convenient  distribution. 
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APPENDIX  A 


A1 ternative  Construction  of  a.  Bivariate 
Pi str ibution  for  Speci f ied  Marginal  Distributions 
and  Covariance  Matrix 


*"6t  *1  *  ^2  tw0  9'ven  mar9'nal  scalar  random  variables  with  prob 

ability  density  functions  f ^ ,  f^  continuous  about  their  medians  @j>  02 

2  2 

possessing  (finite)  variances  a]  >  °2  »  denote  their  absolute  first 

moments  about  their  medians  by  yj1  ,  y£  ,  respectively. 


Let  7^*  (a..)  be  any  given  positive  semidefinite  matrix, 

'J  l<i ,j<2 


such  that 


and 


and 


aii  *  CTi 

Z  •  i 

;  «*i , 

2 

(A-l) 

Q 

K) 

A 

MinCyj’2,  v 

.2* 
l2  * 

• 

(A-2) 

Define  functions 

f  and  h. 

i 

by. 

for  all  outcomes 

(x')eR2- 

f  (X)  = 

2 

2 

n  f  (x  ) 

+  n 

h.(x.)  , 

i  i  ’ 

(A- 3) 

i-l 

i-l 

hi(xi>  =  | 

,i(x!) 

-f.U,) 

,  for  all  x.  >_  e. 

,  for  all  x.  <  e. 

(A-4) 

X  .51 
'  uf  ’ 

Si 

2  y 

12. 

+  9 

2 

if  °12  50 

-Aw 

Wl 

1 

;  if  cr12  <  0 

(A-5) 

1  **1 

,  \2 

*1 
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for  i  -  1 ,2  . 

For  i  *  j , 

Cov(*r*2^  *  X(xrE(^i)(x2'E(^))f(x)dx 

Xe  Rm 


S  (xl-E{x]))fl(x1)dX,) 

v  »•« 

X1 


+ 


+oo 


J*  (xj-E(Xj))hj  (x^dXj)  •  (  J  () 


v  s  —00 
X1 


X 

2 


0  •  0  + 

J  (xj-0j)h^(xj)dx^) (  J(x2-0j 


+  00 


] 


using  (A-7) 


-  YVVP2 

'  °12 


I 


'2'E(x2))f2(x2'dx2) 


2-E(x2))h2(x2)dx2) . 


2 ^x2 ^  * 
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APPENDIX  B 


Multivariate  Transformation  of  Probabi I i ty 
Technique  for  Generating  Outcomes  of 
Arbi tra ry  Random  Variables 

The  univariate  transform  Y  ■  F(X)  of  a  random  variable  X  with 
continuous  cumulative  probability  distribution  F  causes  Y  to  be 
uniformly  distributed  over  [0,1].  This  widely  known  result  is  perhaps 
the  most  useful  in  simulating  outcomes  of  one  dimensional  random  variables 
(See,  e.g.,  the  basic  texts  of  Fisz,  Wilks,  Cramer,  Feller,  etc.)  However 
the  multivariate  extension  of  this  transform  is  another  matter  and  this 
author,  to  the  best  of  his  knowledge,  has  not  seen  such  a  result. 

This  appendix  displays  a  natural  extension  of  the  fundamental  trans¬ 
form  of  probability  theory,  which  hopefully  will  be  of  help  in  simulating 
outcomes  of  arbitrary  multivariate  random  variables. 


x,  m 

Let  X  *  (  .  I  be  a  given  random  vector  over  R  with  positive 

x 

<\,m  , 

probability  density  function  f.  Define  transform  T^:  Rm  ■+  Rm  by, 


for  any  outcome  X 


if 


( *A 

\  xm  I 


nm 

e  R  , 


V  >T  ,,mMI  ■ 


(8-1) 


where 


x. 


i  • 


(B-2) 
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for  i  *  1,  ..  ,  m,  and,  for  j  =  1,  m. 


x 

x(j)  — 


/x.  \ 

xj+i 


m  / 


(B-3) 


and  f.  is  the  probability  density  function  of  marginal  random  vector 

X/ . v  where  also 
-\AJ ) 

X,  .  ,x  sb^  and  f^^X^i))  ==  1,  and  note  the  special 


(m+1 ) 


case  Xqj  ■  X,  f^  =  f. 


Then,  the  random  vector  Y  =  T,(X)  is  uniformly  distributed  over  the 

A*  I 

m-cube  [0,1 ]m. 

(  Proof: 

First  note  that 


Tf,i‘x>  <  <i/fi+)<x(i,|)».  j  f,( 


S 


-  (l/ff  +  ]  (X(i  +  |)5*fj  +  ,  ^X(}  +  J)) 
*  1  , 

for  i  ■  I,  m,  implying,  for  all  Xe  Rm  , 


Tf(X)  e  [0,1] 


m 


(B-*) 


Next,  it  easily  follows  that 


dTf(X)  /  3T 


dX 


j  : 


Nl ,  j<m 


(B-5) 
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is  an  upper  triangular  matrix,  i.e., 


3T,  ,(X) 

— LiJ - -  0 

ax. 

if  j <i  ;  l<i,j<m,  with  (2)  implying 


(B-6) 


3Tf  S(X) 

•  >  I 

3x. 


'  1  /fi+l(x(i+l)) » 


(B-7) 


for  i«l . ,m. 

Hence,  (B-5)  “  (B-7)  implies 


^  dTf (X) ^ 
'  dX  / 


Idet 


l.n. 

i*i 

f(x) 


m  aTf  . (X) 

JjJ - 


3x. 


(B-8) 


The  positivity  of  f  implies  that  from  (B-2) ,  for  X^.+jj  fixed, 

Tf  .(X)  as  a  function  o,  x.  only,  is  monotone  increasing  for  i=l,..,m, 

implying  that  T  is  a  one-to-one  function.  Indeed,  by  defining,  for  any 

fixed  X, . . , , ,  the  function  F.  v  ,  where  for  any  X  e  R, 

(i+J)  ,;X(i+l) 

X 

I)  ds  ,  (B-9) 


—  I  f.,  ( 

l,x(i+i)  s*-»  1  \xfi+ni 


(i+i)/ 


for  i*l,..,m,  with  the  special  case 


F  (x) 

m;X 


(m+l) 


F<*>  *  f  f  (s)  ds, 
m  •  m 

S**oo 


.-i 


and  denoting  the  functional  inverse  by  F.  v 

1  ’X(i+1) 


then  it  follows  that 
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the  inverse  transform  :  Rm  -*■  Rm  is  obtained,  for  any  outcome 


,  by  successive  substitution: 


X  =  T-1  (Y)  == 


Tf,l  M 


Tf '  (Y) 

r  ,m 


(B-iO) 


where  using  the  notation 


X  =  T-:1  (Y)  H  f"1  (y  ) 

m  f  ,m  m  m 


X  .  5  T'1  .(¥)  =  »-l  ,  , 

m‘l  f'm‘'  F  m-i  ;X  ym-I  - 

m 


Xm-2  5  Tf,m-2*V)  "  F  m-2:X(ni_[j[m-2* 


*2't;>  *Fi!x(J)<v2)  ■ 


x.  m  -  f;!x(<x>>  • 


(B-ll) 


Combining  the  one-to-one  property  of  T^,  with  (B-4)  (B-8)  and  the 


matrix  relation,  for  all  Y  e  [0,U 


m 


dT"'(Y)  f  dTf(X)N_1 


dY 


dX 


( B— 12) 


X  -  T“'(Y) 


yields,  for  the  p.d.f.  g  of  Y  at  outcome  Y,  by  the  standard 

'll 
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transformation  of  probability, 


,  dT:l(Y) 

g(Y)  -  f(Tf'(Y))-|det  (  - -  )| 

-  f (T"1 (Y))/f (T“’ (Y)) 

-  1 

Remarks 

1.  It  immediately  follows  that  Y  is  uniformly  distributed  over  [0,1]™, 
i ff  each  scalar  marginal  random  variable  component  of  Y  is  statist i- 
cally  independent,  identically  distributed  uniformly  over  [0,1]. 

2.  Let  Y  be  a  random  vector  uniformly  distributed  over  [0,l]m.  Let  f 
be  a  given  poisitive  p.d.f.  over  Rm.  Then  the  random  vector 

X  =  tJ  (Y)  has  p.d.f.  f  over  Rm. 

r\j  T  % 

3.  Let  X  be  a  given  random  vector  over  Rm  with  positive  p.d.f.  f, 

/V» 

and  let  h  be  any  given  positive  p.d.f.  over  Rm.  Then  the  random 

vector  Z  ==  T  ' (Tf (X) )  has  p.d.f.  h  over  R™. 

'v  n  t  'v 
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